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McLeod (1975, 1977) presents a method for deriving the theoretical auto- 
covariance function of an ARMA model. He notes its uses in simulating ARMA 
processes and in deriving the asymptotic distributions of the estimated auto- 
correlations. The procedure can also be used in deriving ARMA model residuals 
(Ansley and Newbold, 1979); in obtaining the asymptotic distributions of 
parameter estimates and residual autocorrelations (McLeod, 1978); and in 
calculating the exact likelihood function of the Gaussian ARMA model (Ljung 
and Box, 1979; Ansley, 1979; and Dent, 1977). Ansley (1980) and Ansley and 
Kohn (1982) have also extended McLeod's algorithm to vector ARMA models. 

An alternative and computationally superior procedure to McLeod's in the 
univariate case has been proposed by Wilson (1979). It also has the advantage 
that the stationarity of the process may be tested directly within the 
algorithm generating the autocovariances. The procedure for maximum likeli- 
hood estimation proposed by Dent (1977) also i ncorpo-rates a test of station- 
arity, as do some others in that a Cholesky decomposition of the generated 
covariance matrix is later derived. However, this is not general. 

The purpose of this note is to examine the behaviour of the McLeod 
algorithm with respect to stationarity. 

Consider the ARMA(p,q) process {X^} given by 



^t ■ '*’l^t-l ■ ••• “ ‘*’p^t-p ■ ^t ■ ®l^t-l ■ *•* ■ ®q^t-q * 

If p = 0 , the process is always stationary. If p > 0 the process is 
stationary if and only if the roots of the polynomial equation 



( 1 ) 
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k =0 
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all lie within the unit circle. For later reference, denote the roots of (2) 



by z ,z ,...,z , and denote the polynomial V 41 z by 4 )(z) 
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If p > 0 the variance and the first r autocovariances . • • • >Yp) > 

where r = max(p,q), are obtained by solving a system of linear equations. 

The matrix of coefficients of these equations, A say, is given in McLeod 
(1975) and Ljung and Box (1979). Our interest is in how the stationarity of 
(1) affects the solution of these equations. We determine this by expressing 
|Al, the determinant of A , in terms of the roots of (2). 

Consider the matrix A(t) obtained by replacing by (ji^t^ in A . 

The i^*^ row of A(t) may be expressed as the sum of two row vectors, thus: 



i-1 



— i ” ^^ i — 1 ^ ♦•••» *(>0 , 0 . . . 0 ) 



+ ( 0 , 4 )^t\...,(j) t*^,0,...0) , i = 1,2 r+1 



Clearly, “ <t>(t)»’l'or i = l,2,...,r+l, where ^ is the unit vector 

(1,1,...,!)'. Hence, (j)(t) is an eigenvalue of A(t) and so a factor of 
|A(t)|. Similarly, <|)(-t) is a factor of |A(t)l. We may note for later that 
Mt)4,(-t) = I (l-z^t^) . 

'■ = 1 r 

Suppose z(i:±l) is any solution of (2), and (l,z,...,z )' . We can 

P+l-i i -i 

use (2) to write in the form ^ (ji. , .(z'^-z '^) , i = l,2,...,r+l . 

.1 

Note that if r = p , a^ = 0 . Suppose now that z is also a solution of 

• 1 “ r 

(2), and = (l,z ,...,z )' , Then, A(^+^^^) =0 which is possible if 

and only if A is singular. Thus, (1-z.z.) is a factor of lA|. Further, 

^ J 

if (j)^ is replaced by in (2) the roots become {tz^ : i = l,2,...,p} , 

2 

and we can deduce that (1-z.z.t ) is a factor of |A(t)|. Thus, 

P P y ^ 

P(t) = H n (1-z.z.t^) is a factor of |A(t)|. 
i=l j=i ^ 



Note that P(t) is a polynomial of degree p(p+l) in t . If r = p , 
the (k,p+2-k)th element of A(t) has the form (()ipt*^ + terms of lower power) 
for k = l,2,...,p+l . Thus, |A(t)| is also a polynomial of degree p(p+l) . 

If r = q then A(t) has the form 



2 



A (t) 0 

P 



A(t) 



B{t) L(t) 



where L(t) is a lower triangular matrix with units along the main diagonal. 
Thus, |A(t)| = |Ap(t)| and Ap(t) is (p+1) x (p+1) and has the property 
ascribed to A(t) when r = p . Hence, in both cases, |A(t)| is a polynomial 
in t of degree p(p+l) . Further, |A(0)| = 1 = P(0) . Thus, taking t = 1, 
we have shown that 



|A| = n n (l-z.-Zi) (3) 

i=l j=i ^ 

where z^,Z 2 »...,Zp are the solutions of (2). 
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CONCLUSIONS 

From (3) it is clear that |A| = 0 if and only if 
either (i) there is a root on the unit circle; 

or (ii) there are a pair of roots symmetric about the unit circle, i.e. 

z and z~^ . 

It is comforting to know that the procedure will fail and no auto- 
covariances will be generated when the process is non-stationary for either of 
the reasons given. On the other hand, it is clear that a non-stationary 
process which does not satisfy either (i) or (ii) will yield a set of "auto- 
covariances". It may be possible to detect this at once, e.g. may be 
negative or less than Y|^ in magnitude for some k . In general, however, 
these values can be shown to be spurious only by showing that the correspond- 
ing covariance matrix is not positive definite. 

This may be achieved in a routine manner within the overall procedure. 
Dent (1977) suggests a check on the singular value decomposition of the co- 
variance matrix and Pagano (1973) discusses a modified Cholesky decomposition. 
However, if the purpose of the procedure is estimation we may have to generate 
autocovariances from different sets of parameters a large number of times. In 
such a case an algorithm such as that proposed by Wilson, which checks 
stationarity while it generates autocovariances, would clearly be preferable. 
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